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out  under  Grant  AFOSR  76-2937  during  the  12-nionth  period  1 September 
1976  - 31  August  1977.  Ilie  overall  objective  of  the  research  program 
Is  to  make  significant  liiprovements  in  the  state  of  the  art  relating 
to  the  extraction,  representation  and  conputer  interpretation  of  line 
dravdng  data.  Specific  tasks  during  the  reporting  year  were  concerned 
with  (1)  the  reconstruction  of  solid-object  descrlptlais  from  multiple 
photographic  projections,  (2)  the  development  of  programs  for  the 
removal  of  "hidden  lines"  from  the  projection  of  both  planar-faced 
and  quadric-surface  objects,  (3)  the  design  of  a generalized  chain 
coding  schane  for  the  compact  arid  precise  description  of  map  data, 

(4)  the  development  of  a line-drawing  processing  language  (CHAP), 
and  (5)  an  Investigation  Into  seme  new  approaches  to  scale-  and 
orientation-independent  shape  classification. 
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AOTOMATIC  DATA  PROCESSING  TECHNIQUES  FO?  GRAPHIC-DATA 
DISPLAY,  GENERATiai  AND  ANALYSIS 


I 


1.  SUMMARY  OF  RESEARCH 


1.1  General 

Ihis’  Interim  Technical  Report  describes  progress  on  the  research  program 
being  carried  out  under  Grant  APOSR  76-2937  during  the  12-month  period  1 September 
1976  - 31  August  1977.  The  general  objective  of  the  program  is  to  advance  the 
state  of  the  art  of  conputer  processing  of  line-drawing  data.  In  terms  of 
familiar  disciplines,  the  work  bridges  activities  coirmonly  classified  urxier 
pattern  recogiition,  image  processing,  and  ccxrputer  graphics.  Biphasis  is  cn 
the  development  of  efficient  caiputer  techniques  for  processing  line-drawing 

data,  the  extraction  of  such  data  fran  image  arrays,  its  conpact  representation, 

{ 

its  analysis  and  manipulation,  and  its  clcisslfication  (pattern  recogiition). 

Areas  of  application  are  all  aspects  of  map  data  encoding  and  processing,  the 

automatic  generation  and  analysis  of  terrain  contour  maps,  the  reccxistruction 

of  S-diinfinsional  object  models  from  multiple  photographic  projections  (using 

line  -drawing  analysis  techniques),  and  the  detection  and  classification  of 

man-made  features  in  aerial  photographs. 

During  the  past  year,  the  research  effort  was  focussed  on  five  distinct 

tasks.  Each  of  these  is  briefly  sunmarlzed  in  the  following  sections.  A 
number  of  technical  reports  and  Journal  articles  were  published  during  the 
past  year,  describing  the  work  in  considerable  detail.  Abstracts  of  these  are 
given  in  the  section  titled  PUBLICATIONS. 

1.2  Scene  Reconstruction  from  Multiple  Photographs 

During  the  past  year  a major  effort  was  devoted  to  the  problem  of 
ccaistructing  cortputer  models  of  three-dimensional  bodies  from  multiple  photo- 
graphic projections.  The  method  used,  which  was  developed  over  a number  of 
years,  presumes  that  line  drawings  are  first  generated  from  the  photogr^hs 
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and  that  the  Information  from  the  nultiple  line  drawings  (which  may  be 
ln?)erfect  due  to  shadows,  glare,  poor  illumination,  or  computer  llmltatiCMi) 
is  then  combined  to  obtain  a three-dimensional  conputer  model  of  the  scene. 
The  work  was  conpleted  during  the  reporting  period  with  the  achievement 
of  the  stated  objectives  and  the  publication  of  a doctoral  dissertatloi  [11]. 
Two  papers  based  on  this  vrork  were  published  during  the  past  year  [7,8],  a 
third  paper  has  already  been  accepted  for  publication  [9],  and  a fourth  has 
been  submitted  [10]. 

1.3  Programs  for  Hidden-Line  Removal 

During  the  past  year  work  was  ccxtpleted  on  the  testing,  evaluation  and 
docunentation  of  two  quality  programs  for  the  renoval  of  the  hlxlden  lines  in 
the  projections  of  three-dimensional  solids.  The  work  had  been  requested  by 
the  Structures  Division,  Flight  Dynamics  Laboratory,  Wright-Patterson  AFB. 

One  of  the  two  programs,  PDRAW,  is  applicable  to  planar-faced  bodies  and  is 
based  on  the  Loutrel  algoritbm  [12].  This  program  has  now  been  checked  out 
for  the  following  ccnputers  systems:  CDC  6600,  UNIVAC  1110,  IBM  360, 
PDP-11,  and  ADAGE  AGT/30.  A user  manual  for  the  program  was 
published  [1]. 

The  second  hidden-line  removal  program  is  applicable  to 
quadric-surfaced  bodies  and  is  based  on  the  Woon  algorithm  [13]. 
The  program  is  able  to  generate  true  projections  (perspective 
and  orthographic)  of  complex  objects  bounded  by  quadric-surface 
patches  and  to  delete  the  hidden  lines.  Since  a plane  can  be 
regarded  as  a degenerate  quadric  surface,  the  algorithm  will,  of 
course,  also  handle  objects  bounded  by  planar  faces;  however, 
since  It  is  considerably  more  complex  than  the  Loutrel  algorithm, 
it  should  only  be  used  when  the  objects  of  interest  have  one  or 
more  curved  surfaces.  The  program,  QUADRAW,  was  completed  and 
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thoroughly  tested  during  the  past  year.  Implementations  now 
exist  for  the  following  computers:  CDC  6600,  UNIVAC  1110».and 
IBM  360.  A detailed  user's  manual  was  published  [5]. 

1.^  Generalized  Chain  Coding 

A major  investigation  pursued  during  the  past  year  was 
concerned  with  the  development  of  improved  representation 
schemes  for  line-drawing  data,  especially  geographic  map  data. 

Probably  the  best-known  and  most  widely  used  representation 
scheme  for  free-form  line  drawings  (e.g.,  terrain  contour  maps, 
weather  maps,  plots  of  isophotes,  flow  patterns,  etc.)  is  the 
so-called  chain  code  [l4].  Its  popularity  is  generally  attributed 
to  a combination  of  its  elegant  simplicity,  ability  to  yield 
to  powerful  processing  algorithms,  compactness  and  versatility 
[15].  During  the  past  year  a study  was  undertaken  to  generalize 
the  concept  of  the  8-dlrectlon  chain  and  to  determine  whether 
line-drawing  representation  schemes  could  be  realized  that  would 
be  superior  in  terms  of  compactness,  precision  (for  a given  grid 
size),  smoothness,  facility  for  processing,  and  ease  of  encoding. 

The  standard  chain  code  represents  a curve  by  means  of  a 
string  of  straight-line  segments  of  two  lengths,  T and 
where  T is  the  assumed  grid  spacing  and  can  be  made  arbitrarily 
fine.  The  straight  line  segments  connect  8-adJacent  nodes  on 
a square  lattice.  The  possibility  of  considering  grid  nodes 
beyond  those  having  the  8-adJacent  property  has  been  considered 
in  the  past;  however,  it  was  not  explored  in  depth  because  of 
its  apparent  complexity  and  the  lack  of  any  clear  advantages. 
Recent  work  [I6]  has  shown  that  using  nodes  with  distances  of 


3V2  and  even  k/2  offers  some  exciting  possibilities  in  overall 
representation  efficiency. 

Although  the  higher-order  coding  schemes  involve  more 
effort  when  encoding  a given  line  drawing  and  lead  to  somewhat 
more  complex  processing  algorithms  they  permit  more  compact 
representation.  Since  they  Include  longer-length  links,  fewer 
links  will,  in  general,  be  required,  reducing  the  number  of 
calls  on  the  processing  subroutines  (and  thus  in  part  compensa- 
ting for  the  Increased  complexity  of  these  subroutines).  Since 
for  well-quantized  chains,  the  probability  of  occurrence  of  a 
particular  chain  link  decreases  with  Increasing  angular  differ- 
ence relative  to  the  previous  chain  llnk^  the  reduced  number 
of  total  links  also  leads  to  significantly  reduced  storage  re- 
quirements. Finally,  and  perhaps  most  important,  the  increased 
angular  resolution  offered  by  the  higher-order  chain  code 
matrices  permits  the  achievement  of  both  higher  precision  and 
Improved  smoothness  of  curvature. 

1.5  Line-Drawing  Processing  Language,  CHAP 

To  facilitate  the  work  in  line-drawing  processing  and  map 
data  analysis,  a large  set  of  analysis  and  manipulation 
algorithms  was  assembled  into  a special  line-drawing  processing 
language  called  CHAP  [3,6].  The  language  was  subjected  to 
considerable  testing  during  the  past  year.  A version  for  use 
on  an  IBM  360/370  system  is  now  available  for  release.  Versions 
for  UNIVAC  1110  and  CDC  6OOO  series  computers  are  planned  for 
the  coming  year. 
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1.6  Shape  Classification 

A key  element  In  pattern  recognition  is  the  description 
of  shape.  For  two-dimensional  objects,  shape  is  conveyed  by 
the  curving  of  the  boundary  lines  defining  them  and  is  normally 
regarded  as  being  independent  of  scale  and  orientation.  One 
of  the  difficulties  in  any  shape  processing  task  is  the  lack 
of  a definitive  way  of  describing  shape.  The  contour  whose 
shape  is  desired  can  be  represented  in  the  chain  code.  How- 
ever, the  chain  code  representation  does  not  explicitly  dis- 
play the  features  we  normally  regard  as  characterizing  shape, 
and  a more  explicit  shape  description  scheme  is  needed. 

A study  for  an  effective  shape  description  scheme  was 
started  during  the  past  year.  The  approach  followed  was  to 
segment  a given  contour  at  so-called  critical  points  - points 
that  with  varying  degrees  of  confidence,  could  be  reliably  J 

identified.  These  are  discontinuities  in  curvature,  inter-  1 

sections,  points  of  inflection,  curvature  maxima,  and  curve  | 

1 

endings.  The  last-named  are  normally  the  least  dependable 

i 

because  the  ending  may  depend  on  a section  of  a curve  being  1 

occluded  by  another  object  or  lost  in  the  process  of  extract- 
ing the  contour  from  a photographic  image.  Then  for  each 
segment  a set  of  scale-  and  orientation-invariant  features 
may  be  calculated  and  these  used  to  characterize  the  shape  of 
the  contour  segment.  Where  appropriate,  precise  shape  match- 
ing or  fitting  may  then  be  carried  out  using  a curve  correla- 
tion technique  [15]. 


r 1 
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For  the  foregoing  technique  to  be  effective,  good 
procedures  must  be  available  for  extracting  the  critical 
points  from  a chain-coded  curve,  in  spite  of  the  presence 
of  quantization  noise.  Some  excellent  progress  toward  this 

objective  was  recently  made,  especially  with  regard  to  the  i 

] 

extraction  of  curvature  discontinuities  and  points  of  in- 
flection [4],  These  two  kinds  of  critical  points  can  be 
detected  by  means  of  a scanning  line  segment  which  traces 
out  the  contour  while  joining  the  end  points  of  two  chain 
links  spaced  about  5 to  8 links  apart.  (The  exact  spacing 
depends  on  the  anticipated  noise  in  the  contour  and  the 
fineness  with  which  the  contour  has  been  quantized.)  The 
variation  in  the  angular  difference  is  then  monitored  as 
the  segment  traces  out  the  contour.  At  a curvature  discontinuity 
("corner”),  a characteristic,  rapid  variation  in  the  angular 
difference  is  detectable.  At  a pronounced  point  of  inflection, 
there  is  a sharp  change  of  sign  in  the  angular  difference. 

Slow,  "meandering"  kinds  of  inflections  can,  of  course,  not 
be  detected  in  this  way;  they  would  in  any  case  be  unreliable. 
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^ 1.  M.  Potmesil,  "An  niiplementatlon  of  the  Loutrel  Hidden-line  Algorithm." 

Tech.  Report  CRIi-49,  Rensselaer  Polytechnic  Institute,  Troy,  New  York, 

62  p. , September  1976.  (AD-AO36  ^01) 

Abstract ; This  report  describes  an  linplanentatlon  of  a varlatlcsi  of  the 
hldden-Une  algorithm  developed  by  P.  Loutrel.  The  new  algorithm 
produces  hldden-Une  drawings  of  scenes  ccxiposed  of  opaque  polyhedra  as 
well  as  of  sane  more  general  types  of  flat-faced  objects  not  covered  by 
thie  original  Loutrel  algorithm.  The  program  Is  written  In  Fortran  IV 
and  has  been  Inplemented  In  a batch  version  on  a CEXl  66OO  conputer  and 
in  an  interactive  version  on  an  ADAGE  AGT-30  Interactive  graphics 
conputer. 
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2.  H.  Freeman,  "Autcmatic  Data  Processing  Techniques  for  Graphic-Data 
Display,  Generation  and  Analysis".  Tech.  Report  CRL-50,  Rensselaer 
Polytechnic  Institute,  Troy,  New  York,  27  p.,  October  1976.  (AI1-A033  315) 

Abstract : This  Interim  Technical  Report  surtmarizes  the  research 
carried  out  under  Grant  APOSR  76-2937  during  the  period  1 September  1975  - 
31  August  1976.  The  research  activities  were  concerned  with  three 
distinct  problem  areas:  (1)  the  development  of  efficient  algorithms 


and  heuristic  techniques  for  the  reconstruction  of  three-dimensional 


scenes  from  multiple  photographs,  (2)  the  study  of  Improved  coding 
schemes  for  line-drawing  data,  especially  topographic  maps,  and  (3) 
the  development  of  thoroughly  tested  caiputer  programs  for  eliminating 
the  "hidden"  lines  in  perspective  views  of  complex  planar-faced  and 
quadrlc-surface-face  objects.  The  individual  research  areas  are 
briefly  described  and  abstracts  of  the  publications  issued  during  the 
reporting  period  are  given. 
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3.  H.  Preenan,  J.  Paolicelli,  and  M.  PotiuesU,  "Progpanmer’s  Manual 
for  the  CHAP  Ll’~.e-Dravdng  Processing  Language”.  Tech.  Report 
CRL-52,  Raisselaer  Polytechnic  Institute,  Troy,  New  York,  82  p. , 
December  1976.  (AD-A036  391) 


Abstract : This  report  describes  CHAP,  a conputer  language  for 

processing  line  drawings  represented  in  terms  of  the  8-dlrectlon 
chain  code.  The  language  consists  of  a set  of  PORIRAN  subroutines,  most 
of  which  are  machine  Independent.  The  subroutines  may  be  called  by 
a user  program  to  accorplish  specific  line-drawing  processing  tasks. 

The  chain  data  is  stored  in  packed  (machine-dependent)  form  and  is 
unpacked  for  processing.  The  report  lists  all  currently  aveiilable 
CHAP  subroutines  and  provides  all  necessary  Information  for  a CHAP 
programner.  Specific  information  for  different  machine  Inpleraentatlons 
are  given  in  the  appendices.  Thus  far  an  implementation  exists  only 
for  an  lEM  360  coiputer.  However,  Iriplementaticais  for  UNIVAC  1108/1110, 

CDC  6600,  and  ADAGE  AGT  30/130  are  presently  being  planned. 
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4.  H.  Ereenan,  "Shc^  Description  via  the  Use  of  Critical  Points”, 
ft?oc.  TEFE  Conference  on  Pattern  Recogiition  and  Image  Processing, 

TKKK  niihi.  77CH1208-9C.  June  6-8,  1977,  PP-  168-174.  (AD-A040  273) 

Abstract : A key  element  in  pattern  recognition  is  the  description 

of  shape.  For  two-dimensional  objects  (blobs),  shape  is  conveyed  by 
the  curving  of  the  boundary  line  and  is  normally  considered  independent 
of  scale  and  orientation.  The  curving  may  be  regarded  as  a concatenta- 
tion  of  arcs  of  varying  Instantaneous  radii  of  curvature,  possibly 
Interspersed  occaslaially  by  discontinuities.  The  description  of 
shape  is  facilitated  by  segnentlng  the  boundary  line  at  so-called 
critical  points  - comers  (discontinuities  in  curvature),  points  of 
inflection,  and  curvature  maxlrna.  Additional  critical  points  are 
intersections  and  points  of  tangency.  Algoritlms  are  described  for 
extracting  such  critical  points  in  the  presence  of  noise.  An  illus- 
tration is  given  showing  how  the  critical  points  may  be  used  in  the 
development  of  a shape  description  system. 
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5.  M.  Potmesll,  "QUADRAW  User  Manual”,  Tech  Report  CRL-53, 

Rensselaer  Polytechnic  Institute,  Troy,  New  York,  75  p. , June 
1977. 


I Abstract:  Ihls  report  Is  a user  manual  for  the  propram  QUAHIAW 

J 

which  draws  vlsible-llne-projectlon  pictures  of  objects  bounded 

! 

by  sections  of  quadric  surfaces.  The  report  describes  three 
versions  of  the  program,  one  each  for  the  CDC  6600,  Ikiivac  1110 
and  IBM  System  360-370  ccnputers.  It  also  provides  the  necessary 
documentation  to  permit  one  to  modify  the  program  for  any  other 


computer. 
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6.  H.  Freeman,  J.  PaoUcelll,  and  M.  Potmesil,  "Progratmer’s 
Manual  for  the  CHAP  Line-Drawing  Processing  Language”,  Tech. 

Report  CRL-52A,  Rensselaer  Polytechnic  Institute,  Troy,  New  York, 

82  p..  Revised  June  1977* 

Note;  This  is  a revised  and  up-dated  version  of  Tech,  Report 
CRL-52. 

Abstract ; This  report  describes  CHAP,  a computer  language  for 
processing  line  drawings  represented  in  terras  of  the  8-dlrectlon 
chain  code.  The  language  consists  of  a set  of  FORTRAN  subroutines, 
most  of  which  are  machine  independent.  The  subroutines  may  be 
called  by  a user  program  to  accomplish  specific  line-drawing 
processing  tasks.  The  chain  data  is  stored  in  packed  (machine- 
dependent)  form  and  is  unpeicked  for  processing.  Uie  report  lists 
all  currently  available  CHAP  subroutines  arxl  provides  all  necessary 
Information  for  a CHAP  prograirmer.  Specific  information  for 
different  machine  Implementations  are  given  In  the  appendices. 

Thus  far  an  Inplementation  exists  only  for  an  IBM  360  computer. 
However,  inplementations  for  UNIVAC  1108/1110,  CDC  6600,  and  ADAGE 
AGT  30/130  are  presently  being  planned. 
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?•  R.  Sh^lra  and  H.  Freeman,  "Reconstiruction  of  Curved-Surface 
Bodies  fron  a Set  of  liiperfect  Projections”,  Proc.  5th  Int*l 
Joint  Conf.  Artificial  Intelligence,  publ,  by  Dept,  of  Coitputer  Science, 
Carnegie  Mellon  Univ.,  Pittsburgh,  Pa.  15213,  August  1977,  pp. 

628-634. 

Abstract:  A procedure  is  described  for  obtaining  the  description 
of  solid  bodies  fron  a set  of  pictures  taken  from  different  vantage 
points.  The  bodies  are  assumed  to  be  bounded  by  faces  which  are 
planeir  or  quadric,  and  to  have  vertices  formed  by  exactly  three 
faces.  Ihe  line  and  Junction  information  provided  to  the  program 
by  the  pr^rocessor  is  assumed  to  contain  defects  such  as  missing 
lines  or  wrongly  classified  Junction  types.  The  procedure  is  able 
to  build  a descrlpticxi  of  the  bodies  in  spite  of  a moderate  number 
of  such  Inperfectlons.  Use  is  made  of  a set  of  new  granmar  rules 
for  line-drawing  projections  of  curved  and  planar  bodies. 


1 


r 8.  R.  Shapira  and  H.  Freeman,  "A  Cyclic-Order  Property  of  Bodies 

[ vrlth  Ihree-Pace  Vertices”,  TEFK  Trans.  Conputers,  C-26.  (10), 

I October  1977. 

I 

h 

I Abstract ; A cyclic-order  property  is  defined  for  three-dlmen- 

[ slonal  bodies  with  vertices  formed  by  three  faces.  'Die  property 

I is  useful  In  resolving  ambiguities  caused  by  the  extractim  of 

I Imperfect  line  data  from  photographs  of  such  bodies.  Ihe 

I property  augments  the  grainnatlcatL  rules  that  govern  the 

I possibility  or  Impossibility  of  the  existence  of  three-dimensional 

^ bodies  corresponding  to  particular  two-dlmensionad  line-structure 

f project  lexis. 


Abstract ; This  paper  describes  a computer  program  for 
constructing  a description  of  solid  bodies  from  a set 
of  pictures  taken  from  different  vantage  points.  The 
bodies  are  assumed  to  be  bounded  by  faces  which  are 
planar  or  quadric,  and  to  have  vertices  formed  by  exactly 
three  faces.  It  is  assumed  that  a preprocessor  provides 
the  program  with  line  and  Junction  Information  which  it 


has  extracted  from  the  pictures.  The  preprocessor  is 


expected  to  make  mistakes,  such  as  losing  features  or 


providing  misinformation  about  their  nature.  A technique 
is  presented  for  validating  doubtful  features  as  well  as 
for  matching  corresponding  features  extracted  from  the 
different  pictures.  New  grammar  rules  are  developed  for 
line-drawing  projections  of  curved  and  planar  bodies  and 


are  used  as  a tool  in  the  scene  analysis  process.  Each 
picture’s  data  analysis  is  supported  dynamically  by  the  | 


results  obtained  thus  far  in  the  other  pictures’  analysis. 

? 

The  analyzed  data  from  all  pictures  are  grouped  into  sets,  I 

each  corresponding  to  a single  face  (flat  or  curved),  whose 
nature  is  also  determined.  The  sets  are  grouped  again  to 
correspond  to  the  different  bodies  in  the  scene.  The 
program  written  in  PL/I  has  been  tested  successfully  on 


several  scenes. 
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10.  R.  Shaplra  and  H.  Pre«nan,  "The  Cyclic  Order  Property  of 
Vertices  as  an  Aid  In  Scene  Analysis".  (Submitted  for 
publicaticai  In  Carmunlcatlons  of  ACM) 

Abstract : A cyclic-order  property  is  defined  for  bodies 
bounded  by  smooth-curved  faces.  It  Is  shown  to  be  useful 
In  analyzing  pictures  of  such  bodies,  particularly  when  the 
line  data  extracted  from  the  pictures  is  Inperfect.  This 
pi?operty  augments  previously  known  gramnatlcal  rules  that 
determine  the  existence  of  three-dimensional  bodies  corres- 
ponding to  given  two-dimensional  line-structure  data. 


3.  PRESENTATIONS 


Invited  presentations  by  Principal  Investigator : 


1.  ’’Conputer  Assanbly  of  Jig-nSaw  Puzzles”,  ACM  lecture,  RPI, 
l8  November  1976. 

2.  "Some  Recent  Advances  in  Line-Pattern  Coding  Schanes”, 
Conputer  Science  Seminar,  The  University  of  Rochester, 
Rochester,  New  York,  13  December  1976. 

3.  ’’Ccxiputer  Graphics”,  Conference  of  the  Society  of  Engineers 
of  Extern  New  York,  IMion  College,  Schenectady,  New  York, 
25  January  1977. 

4.  "Coiputer  Interpretation  of  a Three-Dimensional  Scene”, 
Colloquium  lecture,  Ecole  Nationale  Superieiore  des 
Telecomnunlcatlons,  Paris,  France,  15  March  1977. 

5.  "Some  New  Coding  Schemes  for  Contour  Map  Data",  Seminar 
lecture,  Gesellschaft  fCir  Mathematik  und  Datenverarbeitung, 
Bonn,  Germany,  16  March  1977. 

6.  "Algorithms  for  Digital  Map  Data  Processing  and  Scene 
Analysis",  invited  lecture.  Conference  on  Automatic  Map 
Data  Processing  and  Related  ^techniques,  Cosenza,  Italy, 
21-22  March  1977. 

7.  "Inplementatlon  of  Hidden-Line  Algorithms",  Adage  Graphics 
Exchange  meeting,  Washington,  D.  C.,  16-17  May  1977. 


! : 
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